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INTRODUCTION 


PURPOSE. 

This  report  presents  an  empirical  approach  to  modeling  Active  Beacon  Collision 
Avoidance  System  (BCAS)  measurement  errors,  specifically,  altitude  measurement 
errors  and  range  measurement  errors.  The  analysis  was  conducted  to  study  the 
characteristics  of  the  BCAS  aircraft  (hereafter  called  own  aircraft)  altitude 
measureswnt  error,  intruder  aircraft  altitude  measurement  error  and  range  measure¬ 
ment  error,  and  to  fit  models  to  the  available  data.  A  secondary  objective  was  to 
compare  own  and  intruder  altitude  measurement  errors. 

SCOPE. 

The  fitted  models  and  their  parameter  estimates  described  in  this  report  are 
based  on  the  analysis  of  two  independent,  but  small,  data  bases.  Therefore, 
the  confidence  regions  for  the  parameter  estimates  are  large.  However,  as  will  be 
shown  later  in  this  report,  analysis  of  both  sets  of  data  resulted  in  highly 
consistent  results. 

More  importantly,  this  report  presents  a  methodology  used  to  obtain  the  mathema¬ 
tical  models  of  Active  BCAS  measurement  errors.  Once  more  data  are  available,  the 
methodology  could  be  used  to  increase  the  accuracy  of  the  parameter  estimates.  The 
methodology  could  also  be  applied  to  develop  altitude  and  range  measurement  error 
models  of  other  collision  avoidance  systems  in  which  similar  tracking  procedures 
are  used. 

BACKGROUND. 

In  previous  efforts  to  identify  the  impact  of  measurement  errors  on  Active  BCAS 
performance  (reference  1),  Monte  Carlo  techniques  were  used  to  simulate  measure¬ 
ment  errors  from  static  (time  independent)  models.  The  methodology  presented  in 
this  report  will  permit  the  development  of  dynamic  (time  dependent)  interactive 
error  models,  without  increasing  the  model  complexity.  This  approach  provides  a 
more  direct  means  of  evaluating  the  sequential  impact  of  measurement  errors  on 
Active  BCAS  conflict  resolution. 

The  two  independent  sets  of  data  were  obtained  from  Active  BCAS  surveillance  test 
flights.  The  test  flights  were  not  designed  to  collect  data  to  support  error 
modeling.  As  a  result,  only  a  small  part  of  the  data  included  theodolite 
measurements.  The  theodolite  measurements  were  required  to  accurately  compute  the 
errors . 

Statistical  tests  indicated  that  the  errors  are  time  dependent  and  independent 
of  their  respective  magnitudes  of  measurements.  Thus,  dynamic  models  are  found  to 
be  more  appropriate  than  previous  static  models.  Throughout  this  report  the  terms 
"altitude  error"  and  "range  error"  are  used  to  mean  "Active  BCAS  altitude  measure¬ 
ment  error"  and  "Active  BCAS  range  measurement  error,"  respectively.  Likewise,  the 
term  "errors"  is  used  to  mean  "measurement  errors." 


MODEL  DEVELOPMENT 


DATA  BASES. 

The  analysis,  described  in  this  report,  was  limited  by  the  amount  of  available 
data.  The  first  data  base  resulted  from  Active  BCAS  flight  tests  conducted  at  the 
National  Aviation  Facilities  Experimental  Center  (NAFEC),  Atlantic  City,  New  Jersey 
(reference  2).  The  set  consisted  of  a  continuous  sequence  of  63  discrete  measure¬ 
ments,  spaced  at  equal  time  intervals  of  1  second,  the  update  rate  for  Active  BCAS. 
This  set  was  collected  when  both  own  aircraft  and  intruder  aircraft  were  in  level 
flight.  Throughout  this  report,  this  set  of  63  data  points  is  referred  to  as 
"level  flight  data."  The  experimental  conditions  under  which  the  level  flight  data 
were  collected  are  described  in  reference  2.  The  level  flight  data  are  included  in 
appendix  A. 

The  second  data  base  consisted  of  46  seconds  of  data  collected  at  NAFEC  and 
obtained  from  the  MITRE  Corporation  (reference  3).  These  data  permitted  analysis 
of  altitude  and  range  error  for  a  vertically  maneuvering  intruder.  However, 
theodolite  (true)  position  measurements  were  not  available  nor  were  own  aircraft 
measurements.  These  were  able  to  be  estimated,  however,  since  it  was  observed  that 
constant  vertical  and  range  rates  were  maintained  across  the  data  collection 
period.  This  set  of  data  is  referred  to  as  "climbing  intruder  data." 

Previous  studies  have  indicated  that  the  transponder  antenna  structure  may  affect 
the  performance  of  Active  BCAS  by  reducing  the  data  link  reliability.  The  level 
flight  data  were  obtained  from  flights  in  which  both  own  and  intruder  aircraft  had 
a  top/bottom  antenna  structure.  The  antenna  structure  of  the  aircraft,  which 
resulted  in  the  climbing  intruder  data,  was  not  reported. 

For  developing  the  error  models,  only  the  level-flight  data  were  used.  However, 
the  climbing  intruder  data  were  also  analyzed  (appendix  B)  for  comparison  purposes. 
Analysis  of  the  climbing  intruder  data  resulted  in  findings  consistent  with  the 
level-flight  data  analysis.  The  analysis  of  climbing  intruder  data  was  patterned 
after  the  level-flight  data  analysis  and  is  included  in  appendix  B. 

"True"  measurements  (theodolite  measurements)  and  BCAS  surveillance  measurements  of 
own  altitude,  intruder  altitude,  and  range  were  included  in  the  level  flight  data 
(reference  2).  The  errors  were  computed  by  subtracting  the  BCAS  surveillance 
measurements  from  the  respective  "true"  measurements.  Plots  of  altitude  errors 
(own  and  intruder)  are  shown  in  figure  1,  and  a  plot  of  range  errors  is  shown  in 
figure  2.  The  mean  errors  are  also  included  in  the  figures. 

The  BCAS  surveillance  data  analyzed  represented  data  for  established  tracks.  The 
Active  mode  BCAS  surveillance  tracker  uses  bracketing  and  altitude  window  search 
techniques  to  acquire  tracks.  Once  the  track  altitude  window  is  formed,  replies 
falling  inside  the  window  are  considered  as  an  update  to  the  altitude  track.  If  no 
replies  fall  inside  the  window  during  the  time  interval,  the  altitude  track  is  not 
updated  for  that  time  period.  The  BCAS  surveillance  tracking  procedure  is 
described  in  more  detail  in  reference  2. 

STATISTICAL  ANALYSIS. 

MEAN  AND  VARIANCE.  The  averages  and  variances  of  the  level-flight  data  errors 
are  presented  in  table  1.  The  own  and  intruder  altitude  information  transmitted  to 
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FIGURE  1 .  SEQUENTIAL  OWN  ALTITUDE  AND  INTRUDER  ALTITUDE  ERRORS — LEVEL  FLIGHT 


Che  BCAS  are  in  Che  same  form,  encoded  mode  C  daCa.  Thus,  one  mighc  expecC  Che 
means  and  variances  of  Cheir  error  sequences  Co  be  nearly  equal.  As  can  be  seen 
in  Cable  1,  Che  own  altitude  error  average  (-44.4  feet  (ft))  and  variance 
(1,354.9  ft2)  are  quite  different  from  the  intruder  altitude  error  average 
(0.3  ft)  and  variance  (579.6  ft2). 


TABLE  1.  MEAN  AND  VARIANCE 


Error 

Average 

(ft) 

Sample  Variance 
(ft2) 

Standard  Deviation 
(ft) 

Own  Altitude 

-44.4 

1,354.9 

36.8 

Intruder 

0.3 

579.6 

24.1 

Alt  itude 

Range 

119.5 

9,007.4 

94.9 

Investigation  of  the  level-flight  data  (reference  2)  identified  a  possible  reason 
for  the  large  bias  in  the  own  altitude  error.  Apparently,  there  was  an  interface 
problem  between  the  own  aircraft  mode  C  encoder  and  the  BCAS  computer.  The  larger 
sample  variance  of  own  altitude  error  resulted  because  of  the  large  peaked  oscilla- 
t  ions  that  occurred  at  t  =  26,  36,  43,  and  51  seconds.  The  peaks  represent  the 
quantization  noise  caused  by  the  100-foot  granularity  in  mode  C  data.  This  quant i- 
zation  occurred  when  the  own  aircraft  measured  altitude  deviated  from  the  assigned 
altitude  of  2,500  ft  by  more  than  50  ft.  Intruder  altitude  errors,  however,  as 
indicated  by  figure  1  and  a  review  of  raw  data  in  reference  2,  showed  that  the 
error  pattern  was  not  affected  by  mode  C  quantization  noise.  The  maximum  value  of 
intruder  altitude  error  (48  ft)  occurred  at  t  =  58  seconds.  This  indicated  the 
intruder  mode  C  reported  altitude  did  not  change  during  the  data  collection  period. 

The  range  measured  was  the  slant  range  between  aircraft.  To  offset  the  increase  in 
signal  turnaround  time  caused  by  the  transponder  reply  delay,  BCAS  assumes  an 
average  transponder  delay  of  3  microseconds  (ps).  The  average  of  the  range  errors 
(theodolite  measurements  minus  BCAS  measurements)  of  119.5  ft  clearly  shows  that 
BCAS  continuously  underestimated  the  range.  This  indicates  that  the  transponder 
reply  delay  of  the  intruder  was  shorter  than  the  assumed  3  ps.  However,  this 
consistent  bias  does  not  have  an  effect  on  the  model  being  developed. 

EMPIRICAL  DISTRIBUTION  OF  THE  ERRORS.  The  histograms  of  the  errors  showed  that  the 
empirical  distributions  of  the  errors  were  uniraodal  and  symmetrical.  Using  the 
method  suggested  by  Hahn  and  Shapiro  (reference  4),  selected  empirical  distribution 
measures  were  computed  to  verify  that  the  errors  were  normally  distributed. 

In  general  the  error  X^  at  t ime  t  is  given  by 

Xt  =  Theodolite  measure  -  corresponding  BCAS  measure. 

( Y 

Let  >  *  a  specified  error  set 
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Chen 


t-1 

■  the  biased  estimate  of  the  kth  moment  about  the  mean. 

Then,  the  square  of  the  standarized  measure  of  skewness  is 
2  3 

*  ^3/ 

and  the  standarized  measure  of  peakedness  is 

h  "  V  *2 

01  *  0  implies  the  distribution  is  symmetric.  As  a  result,  should  be  close  to 
zero  if  the  errors  are  normally  distributed.  For  pure  normal  data  02  =  3. 

Hahn  and  Shapiro  suggest  the  estimates  of  0i  and  02  are  very  sensitive  to  extreme 
observations  in  the  sample,  especially  for  sample  sizes  less  than  200.  The  result 
of  the  analysis  is  summarized  in  table  2. 


TABLE  2.  0i  AND  02  VALUES  OF  THE  ERRORS 


Error 

Sample  Size 

02 

Own  Altitude 

63 

0.14 

1.5 

Intruder  Altitude 

63 

0.00 

2.8 

Range 

56 

0.18 

2.7 

The  results  showed  that  intruder  altitude  error  and  range  error  for  the  level 
flight  data  are  approximately  normally  distributed.  The  own  and  intruder  altitude 
information  supplied  to  the  BCAS  are  from  the  same  source,  i.e.,  the  aircraft 
altitude  encoders.  Thus,  one  might  expect  the  same  distribution  for  own  and 
intruder  altitude  errors.  As  can  be  seen  in  table  2,  the  02  estimate  (1.5)  for 
own  altitude  error  is  low  for  normal  data.  This  is  due  to  the  quantization  noise 
(the  extreme  observations  at  t  =  26,  36,  43,  and  51  seconds  discussed  in  the 
previous  subsection)  present  in  the  own  altitude  error  data. 
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A  review  of  figure  2,  the  range  error  data  plot,  showed  extreme  observations  at 
t  *  17,  18,  19,  and  36.  These  extreme  observations  are  due  to  missed  reports  in 
the  raw  flight  test  data.  The  range  error  values  associated  with  the  missed 
reports  were  replaced  by  the  average  of  two  previous  observations.  The  stand¬ 
ardized  and  02  measures  for  range  errors  shown  in  table  2  were  then  obtained. 

SEQUENTIAL  CORRELATION.  The  plots  of  the  errors  (figures  1  and  2)  indicate  that 
the  error  data  are  not  independent  from  second  to  second.  That  is,  the  sequential 
errors  appear  to  be  time  dependent  or  correlated.  The  null  hypothesis,  i.e.  , 
the  sequential  error  deviations  about  the  average  error  are  sequentially  uncor¬ 
related,  was  tested  using  a  run  test  (reference  5).  A  "run"  in  a  sequence  is  a 
succession  of  elements  with  identical  signs  which  is  followed  and  preceded  by 
elements  of  opposite  signs  or  no  elements  at  all.  Thus,  the  number  of  runs  in  a 
sequence  of  error  deviations  is  equal  to  the  number  of  times  the  sign  changes 
within  the  sequence  plus  1.  These  hypotheses  were  strongly  rejected  at  the 
1-percent  level.  Table  3  presents  the  results  of  the  analysis. 


TABLE  3.  RUN  TEST  RESULTS 


1-Percent  Critical  Values 


Error 

Sequence 

Number  of 
Runs 

Lower 

Upper 

Results 

Own  Altitude 

8 

22 

42 

Reject  H0* 

Intruder 

Altitude 

7 

22 

42 

Reject  H0 

Range 

12 

22 

42 

Reject  H0 

*Null  Hypothesis,  Ho:  No  sequential  correlation. 


Lindgren  (reference  5)  states  the  sufficient  sample  size  for  the  run  test  is 

n  _>  30.  Our  sample  size  of  63  satisfies  this  requirement.  The  test  confirmed  that 
each  sequence  of  errors  is  highly  correlated.  The  number  of  runs  of  own  altitude 
errors  and  intruder  altitude  errors  was  8  and  7,  respectively.  This  indicates  that 
own  altitude  error  and  intruder  altitude  error  may  have  similar  sequential 
character is t  ics . 

AUTOCORRELATIONS .  The  results  of  the  run  tests  led  to  autocor relat ion  analysis  of 
the  level-flight  error  data.  One  of  the  assumptions  involved  in  the  computation  of 
autocorrelation  is  that  the  mean,  variance,  and  autocorrelations  of  the  errors  are 
independent  of  the  absolute  time.  In  general,  Linking  errors  a io  k:u.  .  _ 

stationary  (reference  6).  Later  in  the  report,  it  will  be  shown  that  the  parameter 
estimates  of  the  developed  model  satisfy  the  stationarity  conditions. 

Autocorrelation  is  a  measure  of  sequential  dependence  of  the  error  at  time  t 

on  certain  previous  errors.  The  sequential  position  of  the  previous  errors, 
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on  which  the  measure  at  time  t  depends,  determines  the  autocorrelation  lag.  For 
example,  autocorrelation  for  lag  1  is  the  measure  of  dependence  of  the  error  at 
time  t  { X ( t ) )  on  the  error  at  time  t-1  (X(t-l)).  Similarly,  the  measure  of 
dependence  of  the  error  X(t)  on  the  kth  preceding  error  X(t-k)  is  called  the 
autocorrelation  for  lag  k. 

The  autocorrelation  for  lag  k  can  be  computed  by  letting 
n  ■  the  sample  size 

X(t)  “  the  observed  value  in  the  sample  at  time  t 


then  X  •  -  ^_^X(t)  *  sample  mean 


and  C 


2 

k 


(X(t)  -  X)(X(t+k)  -  X) 


sample  autocovariance  for  lag  k  (k  =  1,  2, 


.) 


Note  that  for  lag  o  the  measure  is  based  on  the  current  state  only  and 


(1) 


C 


2 

0 


<x(t)  -  x)2- 


biased  estimate  of  the  variance 


Using  (1)  the  sample  autocorrelation  for  lag  k,  pfc  is  obtained  as  follows: 
ck2 

pk  *  —  k  =  1,  2,  .  .  .  (2) 

coz 

The  autocorrelations  for  lags  0  to  6  were  computed  and  are  presented  in  table  4. 
The  autocorrelations  for  own  altitude  and  intruder  altitude  errors  do  not  differ 
significantly.  Therefore,  one  could  reason  that  the  sequential  dependence  of  own 
altitude  error  and  sequential  dependence  of  intruder  altitude  error  are  similar. 
This  conclusion  is  plausible  since  the  measuring  process  of  both  own  and  intruder 
altitude  is  similar. 


TABLE  4 .  AUTOCORRELATIONS 


Own  Altitude 

Intruder 

Range 

Lag 

0 

Errors 

Altitude  Errors 

Errors 

1.000 

1.000 

1.000 

1 

0.892 

0.895 

0.681 

2 

0.743 

0.763 

0.420 

3 

0.563 

0.595 

0.197 

4 

0.368 

0.426 

0.059 

5 

0.177 

0.282 

-0.030 

6 

0.030 

0.188 

-0.093 
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PROPOSED  MODEL 


Box  and  Jenkins  (reference  7)  describe  a  dynamic  process  Chat  can  be  used  to 
characterize  sequentially  correlated  time  series  data.  It  is  called  an  auto¬ 
regressive  process.  In  this  process,  the  current  process  deviation  is  a  function 
of  a  fixed  number  (k)  of  previous  process  deviations.  The  fixed  number  k  is 
called  the  order  of  the  autoregressive  process.  A  kth  order  autoregressive 
process  could  be  written  as  follows: 

Let 


X(t)  *  the  value  of  the  process  at  time  t 

ft  *  process  mean 
2 

o  ■  process  variance 

Then,  X(t)  *  X(t)  -  (i  is  the  process  deviation  or  the  unbiased  value  of  the 
process  at  time  t.  Hence,  X(t)  has  mean  -  0  and  variance  *  o^.  (Note:  The 
notation  £(t)  used  here  does  not  represent  a  vector.) 

Let 


Zt  =  white  noise  at  time  t 

and 

|^*i  ^  *  set  of  autoregressive  parameters  for  kth  order  process 

Then,  the  autoregressive  process  of  order  k  (k  >  1)  could  be  expressed  as 

X(t)  *  4>j  X(t-1)  ♦  <t>2  X(t-2)+  .  .  .  +  <>k  £(t-k)  +  Zt;  t  >  k  +  1  (3) 

Where  Zt,  the  white  noise,  is  an  identically  distributed  uncorrelated  random 
variable.  The  distribution  of  Zt  will  be  discussed  later. 

In  the  kth  order  autoregressive  process,  the  current  process  deviation  )((t)  is  a 
function  of  k  previous  process  deviations  ^(t-l),  .  .  .^(t-k).  If  the  above 

process  is  a  stationary  process,  the  process  mean,  variance,  and  autocorrelations, 
P^,  i  *  1,  2,  .  .  .  ,  are  independent  of  absolute  time. 

The  first-order  autoregressive  process  could  be  written  as 

£(t)  *  X(t-l)  +  Z  ;  t  >_  2  .  .  .  (4a) 

and  is  a  stationary  process  if 

-  1  <  *  <  1  .  .  .  (4b) 

For  the  first  autoregressive  process,  the  process  deviation  at  time  t,  £(t), 
depends  only  on  the  immediately  preceding  process  deviation  at  time  t— 1 ,  jC(t-l). 
Thus,  the  first-order  autoregressive  process  is  a  Markov  process.  In  prediction 
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problems  (considering  j((t)  as  the  future  process  deviation  and  £(t-l)  as  the 
current  process  deviation)  the  first-order  autoregressive  process  is  a  process 
which  has  no  memory.  Higher  order  (k>2)  autoregressive  processes  are  not  Markov 
processes. 

A  second-order  autoregressive  process  could  be  expressed  as 

X(t)  -  £(t-l)  +  d>2  X(t-2)  ♦*tit>3.  .  .  (5a) 

where  stationarity  exists  if  the  following  are  satisfied, 

$1  +  <t>2  <  * 

4>l-  <t>2>  -  1 

-  1  <  0  <  1  .  (5b) 

DISTRIBUTION  OF  WHITE  NOISE. 

Equation  3  could  be  rewritten  as 

Z  -  £(t)  -  0  X(t-1)  ...-  0  £(t-k);  t  k  +  1  (6) 

C  1  2 
Since  the  mean  of  ^(t)'s  *  0,  the  mean  of  Z  =  0.  The  variance  a ■  of  Z^ 
is  given  by  Gilchrist  (reference  8)  t 

\  '  (1  -  *1  P1  -  *2  P2  '  '  '  V°2  (7) 

where 

P.,  i  *  1,  2  ...  k  are  the  autocor relat ions  of  jC(t)'s  (equation  (2)). 

If  jC(t)'s  are  normally  distributed,  then  Zt's  are  independent  and  identically 
distributed  normal  random  variables  with  mean  zero  and  variance  given  by 
equation  (7). 


ESTIMATION  OF  AUTOREGRESSIVE  PARAMETERS. 


The  maximum  likelihood  estimates,  MI  ,  of  the  autoregressive  parameters  can 
be  established  from  the  following  recursive  relation  which  was  found  in  Jenkins  and 
Watts  (reference  9): 


C 


2 

i 


.  + 


(8) 


i  ■  1 ,  2,  .  .  .k 

2 

when  C.  are  computed  according  to  equation  (1). 

For  k  ■  2,  that  is  the  second-order  autoregressive  process,  Jenkins  and  Watts 
suggest  a  better  approximation  for  |  0.  1  : 
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p  (1-p  ) 


1 


(9a) 


$2 


(9b) 


DETERMINATION  OF  THE  PROCESS  ORDER. 


The  determination  of  the  proper  order  of  the  autoregressive  process  is  based 
on  the  fact  that  if  an  insufficient  number  of  terms  are  used  in  the  autoregressive 
model,  the  estimate  of  white  noise  variance,  a 2  >  will  be  inflated  by  those 

Zt  2  • 

terms  which  are  not  included.  The  minimum  estimate  of  aL  18  obtained  when 
the  correct  number  of  terms  is  included  in  the  model.  t 


From  reference  9,  the  white  noise  variance  (o2  )  is  estimated  using  the  residual 
variance  S2(k)  where  c 


S^(k) 


n-k 


n-2k-l  ° 
The  minimum  estimate  of 


(1  -  Pj  -  ^2  ?2  •  •  •  ~  ^k  **k) 

is  the  minimum  of  the  set 
Zt 


is2(l),  S2(2)  ....  S2(k)l  -  S2 
"  t  min. 


(10) 


As  a  result,  the  proper  order,  m,  of  the  autoregressive  process  is  that  value  of 

k  such  that  S2(k)  *  S2#  • 

min 


MODEL  FITTING 


The  results  presented  in  model  development  showed  that  the  level-flight  data  errors 
are  autocorrelated ,  stationary,  and  normally  distributed.  Cohen  and  Richardson 
(reference  2)  indicated  that  BCAS  measurements  and  theodolite  measurements  were 
recorded  once  every  second.  Thus,  one  could  consider  each  error  (theodolite 
measurement  -  BCAS  measurement)  as  a  sample  obtained  by  sampling  at  equal  intervals 
of  time  (1  second)  from  a  continuous  time  dependent  process.  The  sample  obtained 
in  such  a  manner  can  be  considered  as  a  discrete  time  series. 

The  error  sequences  showed  strong  autocorrelations.  A  comparison  of  level-flight 
error  data  plots  (figures  1  and  2)  with  climbing  intruder  error  data  plots 
(appendix  B,  figures  B-l  and  B-2)  indicated  that  the  errors  are  independent  of 
their  respective  magnitudes  of  measurements;  that  is,  as  the  measures  of  range  and 
altitude  increase  the  errors  associated  with  these  measures  do  not  increase.  These 
observations  set  favorable  conditions  for  using  autoregressive  models. 


11 


ORDER  OF  THE AUTOREGRESSIVE  MODELS. 


The  technique  described  previously  was  used  to  determine  the  order  of  the  auto¬ 
regressive  models.  The  residual  variances  (S2(k),  k*0,  1,  2,  3,  4)  of  own 
altitude  error,  intruder  altitude  error,  and  range  error  are  presented  in  table  3. 
The  minimum  value  of  S2(k)  in  each  case  is  identified.  A  first-order  auto¬ 
regression  process  (equation  4a)  was  found  to  be  the  appropriate  model  for  the 
range  error  process,  while  second-order  processes  (equation  5a)  were  found  to  be 
adequate  to  represent  own  and  intruder  altitude  errors.  As  expected,  the  own  and 
intruder  altitude  error  processes  have  the  same  order. 


2 

TABLE  5.  ORDER  SUFFICIENCY  BASED  ON  S  (k) 


k 


Range  Error  (ft2) 


Intruder  Altitude 
Error  (ft2) 


Own  Altitude 
Error  (ft2) 


0  9,152.663 

1  4,986.041* 

2  5,402.392 

3  5,566.567 

4  5,687.115 


588.896 

119.159 

116.870* 

136.535 

144.654 


1376.723 

286.078 

271.663* 

310.101 

335.725 


*ninimum  value 


PARAMETER  ESTIMATES. 

The  autoregressive  parameter  estimates  and  the  estimates  of  the  white  noise 
variances  are  shown  in  table  6.  These  estimates  were  computed  according  to 
the  equations  discussed  earlier. 


TABLE  6.  MAXIMUM  LIKELIHOOD  ESTIMATES  OF  THE  AUTOREGRESSIVE 
PARAMETERS  AND  VARIANCE  OF 


Parameter  Estimates 


Error 

Process 

♦l 

*2 

Variance  of 
2t 

Range 

0.681 

- 

4,829.9 

Own 

Alt itude 

1.122 

-0.258 

258.3 

Intruder 

Alt itude 

1.066 

-0.191 

111.1 
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As  indicated  in  the  beginning  of  this  report,  these  parameter  estimates  are 
based  on  a  small  sample  site.  The  parameter  estimates  can  be  updated  when  more 
data  are  available. 

CONFIDENCE  REGIONS/ INTERVALS  OF  PARAMETERS. 

An  approximate  confidence  region  for  kth  order  autoregress ive  parameters  is 
discussed  in  Jenkins  and  Watts.  Only  two  special  cases,  k»l  and  k«2,  need  to 
be  considered.  They  are  the  confidence  interval  of  the  first-order  autore¬ 
gressive  parameter  and  confidence  region  of  the  second-order  autoregresssive 
parameters  (see  figure  3). 

For  the  first  order  process  the  100  (1-a)  percent  confidence  interval  is  given 
by  the  inequality 


A  2 

-  v 


S2(l)  F.  ~( 1-a) 
i  ,n— j 


(11a) 


where  <Pi  is  the  unknown  first  order  autoregressive  parameter,  0j  the  estimated 

value  of  0« ,  S^(l)  the  residual  variance,  F.  (1-a)  the  100  (1-a)  the  percentile 
•  1  j  n— J,  2 

of  an  F  distribution  with  1  and  n-3  degrees  of  freedom,  n  the  sample  size,  and  CQ 

is  the  biased  estimate  of  the  variance. 


For  the  second-order  process,  the  100  (1-a)  percent  confidence  region  is  given 
by  the  inequality 

(0j  -  0i ) ^  +  2  Pi(0i  -  0i )  (02  ~  02^  +  (02  “  02^  <_  2  s  (^)  F^  (lib) 

r? 

o 

where  0i  and  0£  are  the  unknown  second  order  autoregressive  parameters  and  0i  and 
$2  are  the  respective  estimates. 

Figure  3  presents  the  95-percent  and  99-percent  confidence  regions  of  the  own 
altitude  error  process  parameters.  The  corresponding  confidence  regions  of 
intruder  altitude  error  process  parameters  are  shown  in  figure  4.  These  regions 
are  developed  using  relation  (lib).  In  both  figures  the  boundaries  of  the  region 
within  which  the  autoregressive  process  is  stationary  are  the  sides  of  a  triangle 
with  corners  at  (0,-1),  (0,1),  and  (2,0)  (see  equation  (5b)).  These  boundaries 
are  identified  in  both  figures.  The  points  outside  these  boundaries  are  unaccepta¬ 
ble,  since  they  do  not  satisfy  the  stationarity  conditions.  The  confidence  regions 
of  own  and  intruder  altitude  error  process  parameters  overlap  to  a  large  extent. 
This  is  expected  since  they  are  of  the  same  order  and  have  nearly  equal  parameter 
estimates.  An  increase  in  the  data  base  size  would  reduce  the  size  of  the 
confidence  regions. 

The  95-percent  and  99-percent  confidence  intervals  of  the  range  error  process 
parameter  are  respectively  0.494  <  0i  <  0.861  and  0.432  <  0i  <  0.931.  Both 
confidence  intervals  are  within  the  first-order  autoregressive  parameter  sta¬ 
tionarity  condition  (4b),  -  1  <  0i  <  1.  All  parameter  estimates  satisfy  the 
respective  stationarity  conditions  discussed  earlier. 
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FIGURE  3.  CONFIDENCE  REGIONS  FOR  THE  AUTOREGRESSIVE  PARAMETERS  FOR  OWN  ALTITUDE  ERROR  PROCESS 


FIGURE  4.  CONFIDENCE  REGIONS  FOR  THE  AUTOREGRESSIVE  PARAMETERS  FOR  INTRUDER  ALTITUDE  ERROR  PROCESS 


SUMMARY  OF  MODEL  FITTING. 


The  mean  of  Che  measurement  errors  is  assumed  to  be  zero.  The  bias  observed  in  own 
altitude  error  is  due  to  the  altimeter  bias.  The  modeling  of  altimeter  bias  and 
other  types  of  altitude  errors  are  not  included  in  this  report.  The  bias  present 
in  the  range  error  is  due  to  transponder  reply  delay.  The  range  error  process  will 
be  modeled  without  transponder  delay  errors  at  first,  and  then  the  model  will  be 
modified  to  include  transponder  reply  delay  errors. 

ALTITUDE  MEASUREMENT  ERRORS.  In  previous  sections,  the  similarities  in  own  and 
intruder  altitude  error  characteristics  have  been  noted.  They  have  the  same  order 
autoregressive  models,  nearly  equal  autocorrelations  and  parameter  estimates.  This 
was  expected  since  the  own  and  intruder  altitude  information  supplied  to  the  BCAS 
are  similar.  As  a  result,  it  would  be  appropriate  to  represent  both  own  and 
intruder  altitude  errors  with  the  same  model. 

For  the  limited  data  that  were  available,  the  analysis  described  in  the  preceding 
sections  indicated  that  intruder  altitude  error  data  were  more  reliable  than  own 
altitude  error  data  because  they  were  not  affected  by  mode  C  quantization  noise  or 
high  bias  due  to  experimental  errors.  For  these  reasons,  the  altitude  measurement 
error  process  could  be  represented  using  the  parameters  developed  from  the  intruder 
altitude  error  data.  As  a  result,  the  active  BCAS  altitude  measurement  error 
process  can  be  mathematically  represented  as 

^(t)  -  1.066  £A(t-l)  -  0.191  IA(t-2)  +  at;  t  >  3  .  .  .  (12) 

where  £A(t)  *  the  altitude  measurement  errors  at  time  t,  and  at ,  the  process 
white  noise,  is  a  normally  distributed  random  variable  with  mean  of  zero  feet, 
variance  *  111.1  ft2. 

RANGE  MEASUREMENT  ERROR  MODEL.  The  high  bias  present  in  the  range  error  data 
is  due  to  transponder  reply  delay.  Hypothesizing  that  range  measurement  errors 
have  zero  mean  and  are  normally  distributed,  the  range  measurement  error  process 
could  be  written  as 

ER(t)  *  0.681  IR(t-l)  +  bt;  t  >  2  (13) 

where  JSj^t)  *  the  range  measurement  error  at  time  t,  and  bt,  the  process  white 
noise,  is  a  normally  distributed  random  variable  with  mean  *  zero  feet  and 
variance  *  4,829.9  ft2. 

The  bias  in  the  range  error  represents  half  of  the  distance  that  could  be  covered 
at  the  speed  of  light  during  the  transponder  reply  delay  period.  Since  the 
transponder  reply  delay  was  assumed  to  be  3  /is  in  BCAS,  the  bias  in  the  range  error 
depends  on  the  deviations  of  the  transponder  reply  delay  from  the  assumed  3  fis. 
Thus,  the  range  error  bias  is  given  by 

Rb  -  1/2  (983.516)*(d-3)  feet 

where  983.516  feet  is  the  distance  covered  in  1  fia  at  the  speed  of  light  and  d 
is  a  random  variable  (expressed  in  microseconds)  having  the  distribution  of  trans¬ 
ponder  reply  delays.  From  reference  10,  d  is  uniformly  distributed  on  the 
range  [2.5,  3.5J  (ia. 


The  biased  range  error  at  time  t,  ER(t)  is  given  by 

*R<*>  -£r<c>  +  «b 

Substituting  for  ,£R(t)  from  equation  (13), 

ER<t)  -  0.681  £R(t-l)  +  Rh  +  bt;  t  _>  2 

and 

^(t-l)  -  ER(t-l)  -  Rb. 

Hence 

ER(t)  *  0.681  Er( t-1 )  +  0.319  Rb  +  bt;  t  _>  2.  (14) 

CONCLUSION 


Analyses  of  two  independent  sets  of  Active  Beacon  Collision  Avoidance  System  (BCAS) 
flight  test  data  yielded  very  consistent  results.  Although  the  data  base  was 
limited,  initial  autoregressive  error  models  were  developed  for  the  Active  BCAS 
altitude  and  range  measurement  error  processes.  The  consistency  of  the  results  of 
the  autocorrelation  analysis,  the  resulting  autoregressive  parameter  estimates,  and 
the  process  orders  for  the  different  data  sets  support  the  use  of  autoregressive 
modeling  techniques.  Changes  in  the  active  BCAS  surveillance  tracking  functions 
could  require  that  the  autoregressive  parameters  be  changed.  It  is  unlikely  that 
new  data  would  cause  the  process  orders  to  change.  The  models  developed  are  based 
on  the  autocorrelation  of  the  Active  BCAS  measurement  errors.  The  techniques  used 
in  this  analysis  may  be  used  for  analysis  of  similar  data.  Based  on  statistical 
analysis  of  the  available  data,  the  altitude  and  range  measurement  errors  may  be 
represented  by  correlated  Gaussion  stationary  time  series.  Appropriate  models  are 
presented  in  equations  (12)  and  (14). 


RECOMMENDATION 


This  study  strongly  supports  the  use  of  autoregressive  processes  to  characterize 
the  measurement  errors  in  the  Active  BCAS  algorithm  evaluation.  The  major  advan¬ 
tage  of  using  autoregressive  error  model  is  that  the  high  sequential  correlation 
(autocorrelation)  that  exists  in  the  Active  BCAS  measurement  errors  and  their 
interactive  effect  on  Active  BCAS  resolution  can  be  characterized.  The  use  of 
autoregressive  error  models  provides  a  significant  improvement  in  characterizing 
the  Active  BCAS  input  measurement  process  without  increasing  the  model  complexity. 
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FIGURE  A-l .  LEVEL-FLIGHT  DATA 


APPENDIX  B 


CLIMBING  INTRUDER  DATA  ANALYSIS 


Numerous  targets  of  opportunity  that  were  climbing  or  descending  were  tracked 
in  the  Beacon  Collision  Avoidance  System  (BCAS)  flight  tests  at  NAFEC.  However, 
the  data  do  not  contain  theodolite  measurements  (true  measurements).  The  deter¬ 
mination  of  the  errors  required  additional  assumptions.  The  MITRE  Corporation 
provided  a  set  of  data  for  a  climbing  intruder  in  which  the  vertical  climb  rate  and 
range  rate  were  nearly  constant.  The  set  consisted  of  46  seconds  (46  points)  of 
data.  It  was  hoped  that  the  data  would  allow  us  to  determine  if  the  vertically 
maneuvering  intruder  measurement  error  characteristics  are  drastically  different 
from  the  error  characteristics  of  the  level-flight  intruder. 

Since  theodolite  "true"  measurements  were  not  available,  the  "true"  measurements 
were  computed  assuming  a  constant  climb  rate.  The  errors  were  calculated  by 
subtracting  BCAS  measurements  from  true  measurements. 

The  minimum  slant  range  to  the  intruder  (1.64  nautical  miles  (nmi))  occurred 
between  the  28th  and  29th  second  of  data.  A  constant  closure  rate  was  assumed  for 
the  first  28  seconds  of  data,  and  a  constant  separation  rate  was  assumed  for  the 
last  18  seconds  of  data.  The  range  error  is  the  difference  between  the  range 
computed  using  a  constant  closure  rate  and  the  BCAS  slant  range,  and  the  range 
computed  using  a  constant  separation  rate  and  the  BCAS  range  for  the  remaining  18 
seconds . 

Figure  B-I  presents  the  plot  of  climbing  intruder  altitude  error  as  a  function 
of  time.  The  plot  of  range  error  as  a  function  of  time  is  shown  in  figure  B-2. 
The  error  averages  are  indicated  in  both  figures. 

TEST  ORGANIZATION. 


The  objective  of  this  analysis  was  to  justify  the  models.  Preliminary  analysis 
such  as  the  run  test,  correlation  analysis,  and  normality  checks  were  conducted 
on  the  data.  The  results  of  the  analyses  are  not  included  in  this  report.  They 
are  consistent  with  the  results  of  the  level-flight  data  analysis. 

The  means,  variances,  order  of  the  models,  and  parameter  estimates  are  presented 
here.  The  discrepancies,  if  any,  with  the  results  of  the  level  flight  data 
analysis  results  are  explained, 

MEAN  AND  VARIANCE. 

The  means  and  variances  of  the  errors  are  presented  in  table  B-l.  A  comparison 
with  the  values  presented  in  table  1  shows  that  the  variation  in  climbing  intruder 
range  error  is  four  times  the  corresponding  variation  in  level-flight  data.  This  is 
probably  due  to  the  constant  rate  assumption  and/or  the  small  sample  size.  The 
average  of  range  error,  -63.5  feet,  is  due  to  a  larger  than  B-l  expected  trans¬ 
ponder  delay  (>  3  microseconds),  and  thus  BCAS  overestimated  the  range.  The  mean 
of  altitude  error,  7.8  feet,  is  comparable  to  the  average  of  the  level-flight 
intruder  altitude  error  average,  0.3  feet;  the  standard  deviations,  21.1  feet  and 
24.1  feet  are  also  nearly  equal. 
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FIGURE  B-2 .  SEQUENTIAL  RANGE  ERROR  FOR  CLIMBING  INTRUDER 
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TABLE  B-l .  MEAN  AND  VARIANCE 


Average 

Sample  Variance 

Standard  Deviation 

Error 

(ft) 

(ft2) 

(ft) 

Intruder 

Alt itude 

7.8 

445.4 

21.1 

Range 

-63.5 

35363.5 

188.1 

PARAMETER  ESTIMATES  FROM  CLIMBING  INTRUDER  DATA. 

The  maximum  likelihood  estimates  of  the  autoregressive  parameters  and  white  noise 
variance  are  presented  in  table  B-2.  In  the  case  of  range  error,  both  estimates, 
parameter  and  white  noise  variance,  are  much  higher  than  the  respective  estimates 
obtained  from  level  flight  data.  Higher  estimates  were  expected  because  of  the 
higher  variance  of  the  climbing  intruder  range  error  data. 


TABLE  B-2 . 

MAXIMUM  LIKELIHOOD  ESTIMATES  OF  THE 
PARAMETERS  AND  VARIANCE  OF  Zt 

AUTOREGRESSIVE 

Parameter 

Estimates 

Error 

Process 

*1 

Variance  of 

2t 

Range 

0.888 

- 

27785.1 

Alt itude 

0.813 

-0.104 

98.9 

For  the  climbing  intruder  altitude  data,  the  first  autoregressive  parameter  esti¬ 
mate  is  lower,  and  the  second  parameter  estimate  is  higher  than  the  corresponding 
estimates  for  level-flight  data.  It  is  very  likely  that  additional  correlation  is 
introduced  in  the  error  data  by  assuming  a  constant  climb  rate. 

ORDER  OF  THE  MODELS. 

Orders  of  the  autoregressive  models  were  computed  using  the  technique  described 
earlier.  The  results  are  summarized  in  table  B-3. 
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TABLE  B-3.  ORDER  SUFFICIENCY  OF  CLIMBING  INTRUDER  DATA  BASED  ON  S2(K) 


k 

Range 

Error 

Intruder 
Altitude  Error 

0 

36,167 

455 

1 

7,794* 

213 

2 

7,993 

216 

3 

9,199 

216 

4 

— 

213 

^Minimum  Value 

Residual  variance,  S2(k),  showed  unique  minimum  it  k  *  1  in  the  case  of  range 
error,  indicating  a  first-order  autoregressive  process  is  adequate  to  represent  the 
range  error  data.  In  the  case  of  intruder,  altitude  error,  s2(k),  remained 
ataost  constant  for  1  <  k  <  3,  which  indicated  that  a  second-order  autoregressive 
process  was  sufficient.  ~Yhe  results  are  consistent  with  the  results  of  the 
level-flight  data  analysis. 


